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ABSTRACT 
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uate School has a need for additional software to be used in instructing students 
studying signal processing. This software will be used in a PC lab or at home. 

This thesis provides a set of disks written in APL (A Programming Language) 
which allows the user to input arbitrary signals from a disk, to perform various 
signal processing operations, to plot the results, and to save them without the need 
for complicated programming. 

The software is in the form of a digital signal processing “toolkit.” The user 
can select functions which can operate on the signals and interactively apply them 
in any order. The user can also easily develop new functions and include them in 
the “toolkit.” 

The thesis includes brief discussions about the library workspaces, a user man- 
ual, function listings with examples of their use, and an application paper. The 
software is modular and can be expanded by adding additional sets of functions. 
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I. INTRODUCTION 



The Electrical and Computer Engineering Department at the Naval Postgrad- 
uate School has a need for signal processing software packages for use by students 
studying digital signal processing (DSP). The purpose of this thesis is to provide a 
set of tools in the form of APL workspaces on floppy disks that students can use at 
home or at school on IBM-PC-compatible computers for solving digital signal pro- 
cessing problems. Workspace is a collection of functions and data that are placed 
together in order to do any job. 

The software supports the following currently offered courses in DSP: 

1. EC 2400- Discrete Systems 

2. EC 3400-Introduction to Digital Signal Processing 

3. EC 3410-Introduction to Discrete Time Random Processes 

4. EC 4430- Advanced Signal Processing and Spectral Estimation 

5. EC 4440- Multidimensional Digital Signal Processing 

Speciflc APL workspaces were developed for EC3400, EC3410, and EC4440. 
The software uses STSC Corporation’s APL*PLUS PC and STATGRAPHICS sys- 
tems which are both site licensed to the Naval Postgraduate School. APL*PLUS 
PC is STSC’s version of the APL language for the IBM-PC and compatibles. Sim- 
ilar versions of the APL language are also available from STSC for other com- 
puters. STATGRAPHICS (Statistical Graphics System) is a PC software package 
integrating a variety of statistical functions with color graphics. STATGRAPH- 
ICS is written in APL (speciflcally APL*PLUS PC) and offers direct access to the 
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host language. Currently STATGRAPHICS is available only for the IBM-PC and 
compatibles. 

The DSP software developed in this thesis is in the form of a digital signal 
processing “toolkit.” The user can select functions to operate on the signals and 
interactively apply them in any order. The user can also easily develop new func- 
tions and include them in the “toolkit.” The tools are provided on a set of floppy 
disks that users can carry to their own PC machine. The sets of disks contain: 

1. The APL*PLUS Executive Program 

2. STATGRAPHICS disks 

3. UTILITY workspace 

4. EC3400 workspace 

5. EC3410 workspace 

6. EC4440 workspace 

The main products of the research are the disks that include the signal pro- 
cessing library workspace, and the documentation provided in this thesis. A typical 
library contains functions such as: Fast Fourier Transform (FFT), Inverse FFT, 
Sine, Cosine, Sample Autocorrelation, Mean, and other similar functions. In de- 
veloping the DSP software the following requirements were met: 

1. Ability to input/output from/to a disk data file in free format. This allows 
convenient communication with DOS and with programs written in other lan- 
guages or on other computer systems. 

2. Ability to provide for graphic output to represent signals, frequency responses, 
and other functions including 2-D, 3-D, and contour plotting. 

3. Ability to perform filtering, convolution, and other common signal processing 
operations in the signal (time/space) domain. 
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4. Ability to compute transfer functions, to compute frequency responses, and 
generally to perform complex arithmetic and other common frequency domain 
operations. 

5. Abihty to generate random signals. 

6. Ability to compute statistical characteristics of the signals including correla- 
tion functions, spectra, and prediction errors. 

The user can combine functions in any desired order to solve DSP computer 
assignments and can concentrate on the signal processing exercises without the 
need to do complicated programming. 

Although the intent was to develop the signal processing toolkit specifically for 
the IBM-PC and compatibles, the system is portable. STSC has APL available on 
IBM mainframes. Digital Equipment Corporation VAX, (under UNIX and VMS), 
Apple Macintosh, and others. These DSP workspaces are portable to all of these 
systems with few, if any, changes. In addition, the DSP workspaces are easily 
carried over to other APL systems with minor changes to only some of the most 
basic functions; bits and pieces of the software have existed for some time under 
VS-APL on the IBM mainframe and under UNIX 4.3 bsd. 

The remainder of the thesis is organized as follows. 

Chapter II contains a brief description of the APL language and the STAT- 
GRAPHICS software system. Chapter III deals with the DSP library and discusses 
the application of the four workspaces. The Utility workspace includes general 
functions such as GETDATA and PUTDATA for the data input/output to DOS; 
the EC3400 workspace includes basic one-dimensional DSP functions; the EC3410 
workspace includes one-dimensionaJ DSP functions for statistical signal processing; 
and the EC4440 workspace includes multidimensional DSP functions. Chapter IV 
outlines the conclusions, and the benefits of using the entire package as a software 
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toolkit. Appendix A provides a simple user manual for the software package. Ap- 
pendix B provides a fimction library with a brief description of each function. Ap- 
pendix C contains function listings and samples of their use. Appendix D furnishes 
samples of computer assignments and their solutions using the tools developed in 
this thesis. 
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II. APL AND STATGRAPHICS ENVIRONMENT 



The signal processing software is written in APL and uses the APL*PLUS PC 
interpreter and the STATGRAPHICS software system. Although STATGRAPH- 
ICS provides many statistical functions in itself, only the plotting functions from 
STATGRAPHICS axe used. Following is a brief description of APL and the STAT- 
GRAPHICS system. 

A. APL [1] 

Originally APL began as a notation to express mathematical procedures. Its 
originator, Dr. Kenneth Iverson, published his notation in 1962 as A Program- 
ming Language from which the name “APL” is derived [2]. 

One of the strongest advantages of APL is its ability to handle complicated 
array data-structures without extensive programming. The language allows the 
definition of numerical items or a series of items with one symbol. Examples of 
data that can be represented are: 

• SCALAR - A single value 

• VECTOR - A group of scalars 

• MATRIX - A group of vectors 

• ARRAY - A group of matrices 

The language makes it as easy to perform an arithmetic operation using a 
matrix or vector argument as to perform the operation using simple numbers. 
This characteristic is illustrated in the following example. 
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1 



M<-l6 

M 



(define vectors with 6 numbers) 



N 

2 4 6 3 10 12 



NxM 

2 3 13 32 50 72 



(vector multiplication) 



M^3 3 pl9 
M 

12 3 
4 5 6 
7 3 9 



(define matrices with 3 rows and 3 columns) 



N^3 3 P3X1.9 
N 

3 6 9 

12 15 13 
21 24 27 



NXM 

3 12 27 

43 75 108 (matrix arithmetic operation) 

147 192 243 



Notice that when two items are of the same dimensions, the arithmetic operation is 

performed element by element. Thus N xM is not the usual linear algebra product 

of matrices. The latter is realized by a composite operation denoted by +. x. 

N+. xM 
90 108 126 

198 243 288 
306 378 450 
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Scalar arguments are automatically extended to be conformable with the arrays. 
Thus the statement M x 2 yields 

2 4 6 

8 10 12 

14 16 18 

There is frequently no need for loops or similar mechanisms as in other lan- 
guages such as Fortran. Prom the user’s point of view the language performs the 
operation on the elements of the array in parallel without the need for loops. 

Note also that there is no need for dimensions because APL carries the dimen- 
sions of an item along with its definitions. 

APL provides a function to help the user to define or to determine the number 
of elements in the variable. The function represented by the Greek character “/o”, 
is called “shape,” since it gives the form of the variable. On the previous page 
there is an example where we define the matrices M and N using the function “/?” . 
In order to find the shape of any variable, use the function “p” with the variable 
name following it. The following is an example. 

pH 

3 3 

APL has a large variety of mathematical functions that can easily manipulate 
the data and can handle operations on a simple as well as on a complicated level. 
Thus, it is possible to place on a single line a combination of several functions which 
work together in a pipeline. All of this can be done interactively. The fiexibility in 
manipulating array data easily makes the language well suited for single processing 
analysis. The following are a few examples; 
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(outer product) used to define separable 
2-D function x(nl,n2) = xl(nl)x2(n2) 



3 

9 

10 

11 



1 6 

2 0 7 

3 13 

4 2 9 



S *1 ^3 4 



M^-3 3 pi 35790364 

1 3 5 
7 9 0 
3 6 4 



The domino operator (calculate M inverse) 



m 

•0.1313131313 •0.09090909091 0.2272727273 

0. 1414141414 0. 1313131313 •0.1767676763 

0.1515151515 •Q. 09090909091 0.06060606061 



C*-ll 3 6 



(solve Mx = C for x) 

C3M 

0.9090909091 1.04040404 1.757575753 



(check solution by 
multiplying constant vector 

CSMJ'^.XC 1 JkyT • \ 

^0.9090909091 1.04040404 1.757575753 inverSCJ 

+. X is matrix product 



APL uses symbols to represent its own built-in functions and, in addition, APL 
eiUows the user to define other functions. The solution to one problem consists of 
a collection of the programmer’s functions, each one of which can be applied inter- 
actively by the user or can be organized to cziU another function. The advantage 
of this organization is the ease of debugging and that only a few lines of APL can 
do volumes of work. 

APL has a concept called the workspace which is a collection of functions and 
data that are placed together in order to do a job. That collection is stored in the 
computer memory during an APL session and gives the operator immediate 
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feedback and accessibility, and the workspace can be saved on disk and loaded back 
into the memory at any time for future use. 

B. STATGRAPHICS SOFTWARE PACKAGE [3] 

STATGRAPHICS is a Statistical Graphics System written in APL for scientific 
and engineering applications and for data analysis. The software supports dot 
matrix printers, monochrome/color terminals, and pen plotters. It runs under the 
APL*PLUS PC interpreter version 5.0 or later, which allows the user to write 
his own functions. Using STATGRAPHICS in this mode requires familiarity with 
APL. 

The system also has a menu that contains graphic functions, a set of data 
analysis and statistical procedures. This menu is illustrated in Figure 2.1. In 
addition, the menu contains data management and system utilities that allow the 
user to select the system environment, control color, plot dimensions, and so on. 
The most often used screens for DSP applications are; 

1. Plotting functions (Figure 2.2) 

2. Time Series Analysis (Figure 2.3) 

3. Experimental Design (Figure 2.4) 

STATGRAPHICS has options for modifying graphs and for on-line help. 

To use STATGRAPHICS with APL the user needs to start APL*PLUS PC as 
usual and then load the STATGRAPHICS workspace from the start-up disk. By 
going back and forth from the APL environment to STATGRAPHICS, the user 
can process data and plot the results easily. This makes the combination of APL 
and STATGRAPHICS powerful and very convenient to use. 
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STATGSAPHICS Starisrical Graphics Sysremi 



DATA MANAGEMEOT MiD SYSTEM UTILITIES 
A. Oara Managenent 
a. Sysrem Environment 

C. Report Writer and Graphics Replay 

D. Plotter Interface 

PLOTTING AND DESCRIPTIVE STATISTICS 

E. Plotting Functions 

F. Descriptive Methods 

G. Estimation and Testing 

H. Distribution Functions 

I. Exploratory Data Analysis 

ANOVA AND REGRESSION ANALYSIS 

J. Analysis of Variance 

K. Regression Analysis 



TI?CE SERIES PROCEDURES 

L. Forecasting 

M. Quality Control 

N. Smoothing 

O. Tina Series Analysis 

ADVANCED PROCEDURES 

P. Categorical Data Analysis 

Q. Multivariate Methods 

R. Nonparanetric Methods 

S. Sampling 

T. Experimental Design 

MATHEMATICAL MID USER PROCEDURES 

U. Mathematical Functions 

V. Supplementary Operations 



Use cursor keys to highlight desired section. Then press ENTER. 

IHelp 2Edit 3Savscr 4Prtscr 5 6Go 7Vars 3Cmd SReview lOQuit 

INPUT 11/13/37 13:03 STATGRAPHICS Vers. 2.1 

Figure 2.1. STATGRAPHICS Main Menu. 



PLOTTIKG FONCnONS 



1. E-Y Lina and Scattarplots 

2. Multiple X-Y Plots 

3. X-Y-2 Lina and Scattarplots 

4 . Multiple X-Y-2 Plots 
5* Barcharts 

5. Piacharts 

7. Component Lina Charts 



Use cursor keys to highlight desired procedure. Then prass ENTER. 

IHalp 2Edit 3Savscr 4Prtscr 5 6Go TVars 3Cmd SReview lOQuit 

INPUT 11/13/87 13:10 STATGRAPHICS Vers. 2.1 



Figure 2.2. The Plotting Function Menu. 
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TIME SERIES ANALYSIS 



1. Horizontal Time Sequence Plot 

2. Vertical Time Sequence Plot 

3. Seasonal Subseries Plot 

4. Autocorrelation Function 

5. Partial Autocorrelation Function 

6. Cross-Correlation Function 

7« Simple or Seasonal Differencing 
3. Mean or Trend Removal 

9. Box-Cox Transformation 

10 . Periodogram 

11. Integrated Periodogram 
12 • Data Tapering 

13. Plotting vs. Fourier Frequencies 

14. Box-JenJcins ARIMA Modeling 

15. Cross-Correlation Matrix Plot 



CJse cursor keys to highlight desired procedure. Then press ENTER. 

•IHelp 2Edit 3Savscr 4Prtscr 5 6Go 7Vars 3Cmd SReview lOQuit 

INPUT 11/13/37 13:13 STATGRAPHICS Vers. 2.1 



Figure 2.3. The Time Series Analysis Menu. 



EXPERIMENTAL DESIGN 



1. Full and Fractional Factorials 

2. Central Composite Designs 

3. Alias Structure 

4. Response Surface Plotting 



Use cursor keys to highlight desired procedure. Then press ENTER. 

IHelo 2Edit 3Savscr 4Prtscr 5 6Go TVars 3Cmd 9 Revi<aw loouitt 

Figure 2.4. The Experimental Design Menu. 
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III. THE DSP WORKSPACES AND APPLICATIONS 



The following is the principle part of the thesis research. This chapter describes 
the workspaces that were developed by the author, and the way they can be applied. 

A. UTILITY WORKSPACE 

This workspace contains functions of general use that can be applied in combi- 
nation with functions from other workspaces in this package. Appendix B contains 
the list of workspace functions and a brief discussion of each one. 

Two of the most useful functions in the utilities are described and demon- 
strated below. The functions GETDATA and PUTDATA allow the user to transfer 
data from the APL environment to the DOS environment and vice versa. These 
functions use file system commands that are specific to STSC’s implementation on 
the IBM- PC. As such, the exact APL code for GETDATA and PUTDATA is not 
always portable to APL on other systems. However, versions of GETDATA and 
PUTDATA can be written for any system. Versions are currently available for the 
IBM mainframe under VS/APL and for a version of APL under UNIX 4.3 bsd on 
the VAX. To the user, GETDATA and PUTDATA provide a common interface for 
communication with other programs. 

The following is an example showing the transfer of data using the GET- 
DATA and PUTDATA functions. Figure 3.1 describes two sets of data in an APL 
workspace. In order to transfer those sets to a file in the DOS environment the 
user needs to type the following commands: 
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X PUTDATA ‘X.DAT’ 



Y PUTDATA ‘Y.DAT’ 



is 5 X 5 and yisa2x4x4 array 


0.925 


X 

1.35 


2.775 


3.7 


4.S2S 


5.55 


6.475 


7.4 


3.325 


9.2S 


10.175 


11.1 


12.025 


U.95 


13.375 


14.3 


15.725 


16.65 


17.375 


13.3 


19.425 


20.35 


21.275 


22.2 


23.125 



Y 

1£60 


2E60 


3E60 


4E60 


5E60 


6E60 


7E60 


3E60 


9E60 


1E61 


1E44 


“2E44 


•3E44 


*4E44 


•5E44 


•6E44 


•7E44 


•3E44 


•9E44 


1E45 



"1.1S45 1.2E45 “1.3E45 "1.4E4S 
'1.3E45 ”1. SE45 “1.7E45 *1.3E4S 
■1.9E45 ■2E45 '2.1E45 *2.2E4S 



Figure 3.1. X and Y Data Sets. 



The left argument to PUTDATA is the variable name; the right argument is the 
file name or path. Note that after transferring any data set to DOS the data is not 
erased and remains available in the workspace. 

When terminating APL, the user is placed in the DOS environment. Figure 
3.2 shows that the data set transfer was successfully completed. Note that the first 
line of the data set gives the dimension or “shape” of the data. 

By going back to APL environment and typing the commands: 

X^GETDATA ‘X.DAT’ 

Y^GETDATA ‘Y.DAT’ 

the data is transferred correctly from the DOS environment to the APL workspace. 
Figure 3.3 shows that the data has the same original shape. The data are read 
into the workspace and assigned to the variables X and Y . The data still remain 
available as a file in the DOS environment. 



13 



)OFF 



( terminate APL) 



c:\APL>TYPE x.OAT (type of contents of files) 





5 


5 




0.925 


1.35 


2.775 


3.7 


4.625 


5.55 


6.475 


7.4 


3.325 


9.25 


10.175 


11.1 


12.025 


12.95 


13.375 


14.3 


15.725 


16.65 


17.575 


13.5 


19.425 

23.125 


20.35 


21.275 


22.2 



C:\APL>TYPE Y.OAT 



2 4 4 



1E60 


2E60 


3E60 


4E60 


5E60 


6E60 


7E60 


3E60 


9E60 


1E61 


-1E44 


-2E44 


-3E44 


•4E44 


-5E44 


-6E44 


-7E44 


-8E44 


-9E44 


-1E4 5 


-1.1E45 


-1.2E45 
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Figure 3.2. X And Y Data Sets In DOS Environment. 
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Figure 3.3. Getting X And Y Into APL Workspace. 

B. EC3400 WORKSPACE 

EC 3400 is a course at the Naval Postgraduate School that introduces first 
principles of digital signal processing. The topics covered include; the Discrete 
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Fourier Transform and the FFT algorithm, flow-graph and matrix representation 
of filters, ideal filters and approximation, and design of recursive and nonrecursive 
digital filters, fast convolution and correlation. 

The following workspace enables the student to solve computer assignments on 
the above subjects in a simple way. This workspace contains functions such as: lin- 
ear convolution, circular convolution, FFT, inverse FFT, and complex arithmetic. 
Some of those functions will be described later. In addition, the EC3400 workspace 
contains functions which allows the student to design one-dimensional filters. The 
methods used are the Fourier method and the frequency sampling method and 
windowing of the filters coefficients. The full description of the workspace is given 
in Appendix B. The following is an example of how to use this workspace. 



EC 3400 Computer Assignment [4 



A highpass filter is to have an analog cutoff frequency of 6kHz. The filter is 
to be implemented by a digital filter having a sampling frequency of 40kHz. Plot 
the frequency response of the filter with and without a Hamming window if 51 
coefficients are used. 



Solution 

The solution given here uses functions provided in the EC3400 workspace. In 
an actual classroom assignment, students may be asked to generate their own func- 
tions or to solve the problem in their own way. By using the function DIG FREQ, 
the digital cutoff frequency is calculated. (Figure 3.4). This function, like several 
others is included for convenience only; the calculation in converting radian to dig- 
ital frequency can be done easily in the workspace by using the built-in arithmetic 
operations. Figure 3.5 describes the ideal frequency response to be generated. 
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By using the function HPCOEFF, 51 causal impulse response coefficients axe cal- 
culated. (See Figures 3.6 and 3.7). The function HPCOEFF uses the following 
equation: 



= k/Tr(n — I) sin([n — I]9c)i n = 0, 1, 2, . . . , 2/ 



TC«-40000 DIGFREQ 3000 
TC 

1.2b66Z r061 
TC+PI 

0.4 



Figure 3.4. Calculating a Digital Cutoff Frequency. 




O 20 40 60 SO 

t:het:a CxPI/6-43 

Figure 3.5. The Ideal Frequency Response. 
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hHP<-51 HPCOEFF TC 



hHP 

6.863316733E~17 ■0.01261377381 "S. 134639424E~3 3. 504443034E~3 0.01441574 
2.339861191E"17 "0.01593319429 "0.01039432538 0.01100575628 
0.01892066322 2.339361191E"17 "0.02162362032 "0.01439214283 
0.01559148306 0.02752097195 2. 339361191E"17 "0.0336367435 "0.02338 
0.02672326525 0.05045511524 2. 339861191E"17 "0.07563267286 
"0.06236595225 0.09354392333 0.3027306915 "0.6 0.3027306915 
0.09354392338 "0.06236595225 "0.07568267286 2. 339361191E"17 
0.05045511524 0.02672826525 "0.02333723209 "0.0336367435 2.3393611 
0.02752097195 0.01559143806 "0.01439214233 "0.02162362082 
2.339361-191£"17 0.01892066322 0.01100575623 "0.01039432533 
"0.01593319429 2. 339361191E"17 0.01441574721 3. 504443034E"3 
"8.134639424E"3 "0.01261377831 6. 363316733E"17 

Figure 3.6. Calculating the Impulse Response Coefficients. 



51 coeff*. for- caLUS-a.1 nonx'ocuji's i s/e 



HP f i 1 -ter- 




Figure 3.7. The Impulse Response Coefficients. 



The function HAMMING generates samples of a shifted Hamming window 



using the following equation: 



W{n) = 0.54 + 0.46 cos 



/ 27rn 

vrri 



,0 < n < /- 1 



This is multiplied by the filter coefiicients to obtain the windowed coefficients. (See 



Figures 3.8 and 3.9). 

By using the function FREQRES, the frequency response with and without a 



window is generated. This is done by calculating the DFT of the filter coefficients 
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WfHAMMING 51 



W 

0.08087246878 0.08783237415 0.1016466798 0.122105975 0.1489001176 0.1816 
0.2197783849 0.2627880673 0.31 0.3606984983 0.4141150246 0.4694398 
0.5258342731 0.5824434454 0.6384092183 0.6928832078 0.7450396437 
0.7940878876 0.8392844181 0.8799441019 0.9154505797 0.9452656094 
0.9689372255 0.9861065906 0.9965134344 1 0.9965134344 0.9861065906 
0.9689372255 0.9452656094 0.9154505797 0.8799441019 0.8392844181 
0.7940878876 0.7450396437 0.6928832078 0.6384092183 0.5824434454 
0.5258342731 0.4694398388 0 . 4141150246- 0. 3606984983 0.31 0.2627880 
0.2197783849 0.1816229357 0.1489001176 0.122105975 0.1016466798 
0.08783237415 0.08087246878 



hHPW«-hHPxW 



Figure 3.8. Calculating the Hamming Window Samples. 




Figure 3.9. The Hamming Window. 

and finding the magnitude of the result as shown in a section of the FREQRES 
function (Figxire 3.10). The following describes the APL commands which generate 
the frequency responses and Figmres 3.11 and 3.12 show the corresponding results. 

HHP^128 FREQRES hHP 
HHPW<-128 FREQRES hHPW 
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VFREQRESC037 

CO] HW4-M FREQRES h;OIO;N;H 
Cl] n 

C2] n GENERATING FBEQ0ENCT RESPONSE MAGNITCJDE AND PHASE FROM TIME DOMAIN 

C3] n COEFFICIENTS 

C4] A 

C5] 010<-0 

C6] N<-(M-phJpO 



C3] 


H5-FFT h 




C93 


HW«-(M-5-2]TCXMAGN 


H] 


CIO] 


PW«-(M-5-2]T(XPHAS 


H] 



Cll] •♦O 

C12] A THE FUNCTIONS FFT , XMAGN . XPHASE ARE USED. 

C13] A IN ORDER TO RECEIVE A BETTER RESOLCJTION THE COEFFICIENTS ARE ZERO- 
C14] A PADDET TO 'M' SAMPLES. 

CIS] A M«-NUMBER OF SAMPLES INCLCTOING ZERO PADDING CUSE ONLT RADIX TWO NO 
C16] A h<-THE FILTER COEFFICIENTS CVECTOR] 

C17] A HW: FREQUENCY RESPONSE MAGNITUDE CM-5-2 SAMPLES] 

C13] A PW;FREQUENCY RESPONSE PHASE CM-5-2 SAMPLES] CRAD. ] 

Figure 3.10. Using the Function FFT. 



m 

a. 

3 

n 

i 

-b 



u 

dL 




Figure 3.11. The Frequency Response Using 51 Coefficients. 

C. EC3410 WORKSPACE 

EC '3410 is a course that gives an introduction to discrete-time random process. 



The topics covered are: description of discrete-time random signals and random 



vectors, linear transformations, sampling of continuous-time random signals, esti- 



mation, and spectral analysis. The EC3410 workspace was developed in order to 



enable the student to solve computer assignments in digital signal processing and 
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Figure 3.12. The Frequency Response Using Hamming Window. 

leaxn to write algorithms in an efficient way without doing excessive programming. 
This workspace contains functions that compute the mean, circular convolution, 
linear convolution, fast Fourier transform, power spectrum and other quantities. 
A full description of the workspace functions is given in Appendix B. 

By using the STATGRAPHICS software package with the EC3410 workspace, 
a graphic capability is achieved. The following is a computer assignment in statis- 
tical dsp and its solution using the EC3410 workspace and the STATGRAPHICS 
software. 

Note that in the actual assignment, students are required to write some of the 
functions that are used below. However developing the functions in APL using the 
tools provided is not difficult. 
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EC 3410 COMPUTER ASSIGNMENT [5] 

1. Three data sets SLl.DAT, SL2.DAT, and SL3.DAT eire given on a disk. The 
mean of the signal data SLl.DAT is 0.75. Subtract this constant value from 
the signal to generate a new zero- mean signal SLl' that you will use in this ' 
assignment. The other data sets (SL2, SL3) have zero mean. Do the remaining 
parts for each of the data sets SLl', SL2, and SL3. 

2. Using the correlation method, generate a 3 by 3 Toeplitz correlation matrix 
for the signal data. Print this matrix. 

3. Solve a set of Normal equations involving the correlation matrix that was just 
generated to obtain the 2nd order linear predictive filter parameters and the 
prediction error variance. 

4. Apply the filter to the original data set and generate the prediction error 
signal. Plot this signal and compute its variance. Does it compare well with 
the theoretical prediction error variance you obtained by solving the normal 
equations? 



Solution 



1. By using the function MEAN, the SLl data set mean is computed and is 
subtracted from the original SLl. The new data set SLl' has a zero-mean. 
(Figure 3.13) 



M<-MEAN SLl 
M 

2.065552043 

SLl^SLl-M 

SLl 

H 

S.982261991E“17 



Figure 3.13. Using the Function MEAN. 
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Rl*-3 SACF SLl 



R1 

3.575461794 3.055195789 7.537100879 
KlMTOV R1 
K1 

3.575461794 3.055195739 7.537100379 
3.055195739 3.575461794 3.055195739 
7.537100379 3.055195739 3.575461794 



Figure 3.14. Using the Functions SACF to Evaluate the Covariance for 
SLl.DAT. 



R2«-3 SACF SL2 
R2 

1.214143223 0.539008547 0.2762704521 
K2«-C0V R2 
K2 

1.214143223 0.539003547 0.2762704521 

0.539003547 1.214143223 0.539003547 

0.2762704521 0.539003547 1.214143223 



R3«-3 SACF SL3 
R3 

9.410119655 "3.931635734 3.467433519 
K3«-C0V R3 
K3 

9.410119655 "3.93X635734 3.467433519 

"3.931635734 9.410119655 "3.931635734 

3.467433519 "3.931635734 9.410119655 

Figure 3.15. Using the Functions SACF and COV for SL2 and SL3. 

2. By using the function SACF (sample autocorrelation fimction), the first three 
correlation function lags axe calculated and then by using the function COV a 
Toeplitz matrix is generated from the correlation function data. The process 
described in the above paragraph is repeated on the SL2 and SL3 data sets, 
as seen in Figures 3.14 and 3.15. 



3. The function LPFP (linear prediction filter parameters) solves the Normal 
equations and it calculates the 2nd order filter coefficients and the prediction 
error as demonstrated in Figure 3.16. (This could also be done without the 
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al4-2 LPFP SLl 



a2^2 LPFP SL2 



al a2 

1 •0.9666951939 0.02913175079 1 *0.4900717314 0.01020142115 

PERR PERR 

1. 008111643 0.9233051353 



a3^2 LPFP SL3 



a3 

1 0.9593733731 0.01077400633 
PERR 

0.9325296297 

Figure 3.16. Solving the Normal Equations Using the Function LPFP. 

LPFP function by setting up simple linear equations and solving them as 
described in Chapter II.) 

4. Using the LCV (linear convolution) function, the three data sets are convolved 
with the 2nd order filter pareuneters that were found in the previous step to 
■ provide the prediction error sequence. The prediction errors of the signals 
are determined by computing the initial value of the autocorrelation function 
of the prediction error sequence as seen in Figure 3.17. As can be seen, the 
results are very similar to the prediction error values derived by the analysis 
of Figure 3.16. Figure 3.18 is a plot of the prediction sequence for each data 
set. 

Additional examples of using the EC3410 workspace axe provided in Appendix 
D. 



D. EC4440 WORKSPACE 

EC 4440 is a course at the Naval Postgraduate School in multidimensional 
digital signal processing. The course deals with the analysis of signals that are 
functions of the two or more independent variables. The course develops both 
time/space and frequency domains approaches and highlights the subjects that 
are different from one-dimensional signal processing. Some of the topics covered 
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al^2 LPFP SLl 



aX 

1 "0.9666951989 0.02913175079 
PEER 

1.003111643 



a2^2 LPFP SLl 



a2 

1 "0.4900717314 0.01020142115 
PEER 

0.9233051353 



a3^2 LPFP SL3 
a3 

1 0.9593733731 0.01077400633 
PERR 

0.9325296297 

Figure 3.17. Calculating The Prediction Error Using The Function PRER. 

axe: two-dimensional circular and linear convolution, difference equations, recur- 
sively computable systems, Fourier analysis, and methods of 2-D filter design. The 
EC4440 workspace enables the student to solve computer assignments in multidi- 
mensional signal processing by using functions such zs: 2-D convolution, 2-D Fast 
Fourier Transform (FFT) and inverse 2-D FFT, and filter design using the win- 
dowing method or the McClellan transformation. The plots are provided by using, 
as before, the STATGRAPHICS software package. More detailed lists and descrip- 
tions of the workspace functions are provided in Appendices B (DSP library) aind 
C (functions listings and samples of runs). 
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50OWWM W05050M 



PREDICTION ERROR OF SLl 



4 - 

2 . 4 
0.4 
- 1 . 6 
-3- 6 

O lOO 200 200 400 500 SOO 

TIME SPMPELS 




PREDICTION ERROR OF SE2 




TIME SAMPLES 



PREDICTION ERROR OF SL3 




TIME SAMPLES 



Figure 3.18. The Prediction Errors For SLl, SL2^ And SL3. 
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The following is an example of how to design a lowpa^s filter using the workspace 
functions. The design here is done by the McClellan transformation method. 
Again, as in other examples, the students are asked to write some of these functions. 



COMPUTER ASSIGNMENT ON McCLELLAN TRANSFORMATION [6] 
Consider the prototype filter: 

II 1 



— 7T — AtT AtT 7T U> 

1. Using a 32 point FFT, find the impulse response hp(n) and the coefficients 
a(n) in the representation 

N 

Hp(u>) = ^ a(n)Tn [cos w] N = 15 

n=0 

2. Now let F{ujitU! 2 ) = | (—1 + coswi + cosu ;2 + coso;i • cosu; 2 ) 

Compute 3nd generate both 3-D and 

contoinr plots of this frequency response. 

Note: You can taice advantage of the recursion 

T„(x) = 2xT„_i(x)-Tn-2(x) 

and the built-in recursive nature of APL functions to generate the Chebyshev 
polynomials. 
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Solutio n 



The function PROFILT is used to specify a 32-sample ideal lowpass prototype 
filter; then by using the function COEFF the impulse response coefficients are 
calctdated. As shown in the following steps the COEFF function uses the IFFT 
function to calctJate the impulse response, h(n), of the prototype filter. 



703EFFCn:v 

tOI a«-COEFF Hp;aiO;SIZE;HH;H 
Cll n 

C21 n COMPUTING THE COEFFICIENTS FROM THE PROTOTYPE FILTER C USING IFFT) 
C31 n 
C4 3 QI0«-0 

C5) SIZE«-(pHp)+2 
C6) a<-SIZEflO 
I C7] H<-IFFT Hp I 



The filter coefficients are defined as: 

f h{0), n = 0 
a(n) ^ I 

2h{n), n > 0 

and are foimd by performing the following steps in the function COEFF. 



C31 


HH<-(1.SIZE)TH 


C93 


HHoSIZEoHH 


CXOJ 


aC uSIZE3«-2xHHC LSIZEJ 


Cll] 


aC03*-aC0)^2 


C12J 


-►0 



tl3) A 

CX41 A Hp<*THE PROTOTYPE SAMPLES 
CIS) A a: THE IMPULSE RESPONSE COEFFICIENTS 
C16) A THE IFFT FUNCTION HAS BEEN USED. 
C17I A 

C13I A Y.KATZXR.I.A.F. . OCTOBER 1937 
C19) A 
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HP«-PROTFILT 32 



a<-COEFF HP 



HP 

11111110000000000000000000111111 



a 

0.40625 0.610186359 0.1779349416 "0.1365836039 "0.1508333476 0.0129955742 
0.110335429 0.0464416397 "0.0625 "0.07130573562 0.01466457095 
0.07052675554 0.02538834765 "0.0504371114 "0.05298494156 0.01823057754 



Figure 3.19. Calculating the Impulse Response Coefficients. 



PEOTOTl?* fILTES H(u) 




Sainpiss C(i)3 

Figure 3.20. 1-D Prototype Filter. 

The above calculations are demonstrated in Figure 3.19. (Notice that the prototype 
filter response is defined on the interval 0 to 27T rather than — tt to + tz .) Figures 
3.20 and 3.21 are plots of the prototype filter and the prototype filter coefficients. 

The ideal filter would have a step discontinuance at the points uj = 0 . 47 T 
and I.Gtt but this appears in the plot as slanted lines because the plot uses finite 
numbers of samples. 
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PSOTDTiTi FILTS2 .COEFFICIENTS h(n) 




Samples (n) 

Figure 3.21. The Prototype Filter Coefficients. 

The function TRANSFNC generates the transformation function by imple- 
menting the following equation: 

F(wl, w2) = 0.5(— 1 -|- cos wl -1- cos w2 -1- cos wl • cos w2). 

The surface plot capability of STATGRAPHICS is used to form a 3-D plot and a 
contour plot of the transformation function as seen in Figure 3.22. 

By using the function MCCLEL the frequency response of the desired filter is 
generated. The function generates the nth Chebyshev polynomial, Tn[F(tul, u;2)] 
by using the recursion T„(x) = 2(x)Tn-i(x) — T„_ 2 (x). By using the following 
sunomation: 

N 

^ a(n)Tn [F(tyl, w2)] 

n=0 
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fliifT2AriS?NC 32 




Contour plot 




Figure 3.22. The Transformation Function. 
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the frequency response H{w\^w2) is achieved. The above steps are shown in a 



section of the MCCLEL function. 



TMCCLELCniV 

C03 Hw^a MCCLEL r;aiO;N;XNTER;NUMBER;INTERl;IMTERO 
C13 « 

C2 3 « DESIGNING 2-D FILTER USING MEcCLELLAN TRANSFORMATION 

C31 A 

C4I DIO^O 

C 5 3 INTERO^INTERl^INTER^Hww<- C p F 3 p 0 

C63 NUMB^ R^*oa^ 

i.7J " 

C33 LOOP:->C CN=0) ,N=13/A.B 
C9 3 INTER^C2xFxINTER13-INTER0 
C103 -k: 

C113 A:INTER^CpF)pl 
C12 3 INTERl^-INTER 
C133 -►C 

C14 3 B:INTER<-F 

CIS I C:Q<-' CALCULATED CHEB. POLYNOM OF ORDER: iN 
C16 3 Hww^Hww^CaCN3xINTER3 
C17 3 INTERO^INTERl 
C13 3 INTERl^INTER 

C19 3 ■>(NUMBER>N^N^l)/LOOP — 

C20J ->0 
C213 P 

C223 P F^THE TRANSFORMATION MATRIX (CALCULATED USING TRANSFORMATION 
C233 P FUNCTION) 

C243 P a^THE PROTOTYPE IMPULSE RESPONSE COEFFICIENTS 
C253 P HwrTHE 2-D FREQUENCY RESPONSE- 
C263 P 

C273 p Y.KATZIR,I.A.F. . OCTOBER 1987 
C233 P 



Figure 3.23 shows the frequency response plot of the lowpass filter. In order 
to apply a status report during calculation, a status printout was added to the 
function as seen in Figure 3.24. 



E. DISCUSSION 

The workspaces and functions developed in this thesis provide a complete 



set of tools for solving the problems currently assigned to students in courses EC 
3400, EC 3410, and EC 4400. They also provide capabilities to solve many other 
problems in DSP. 




•I* 0lC (U 3 



HUU<-a MCCLEL FU 




Contour plot (MCcLZLLhN Transformation) 




Figure 3.23. The Frequency Response of the Lowpass Filter. 
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CALCULATED CHEB, 
CALCULATED CHEB. 
CALCULATED CHEB. 
CALCULATED CHEB. 
CALCULATED CHEB. 
CALCULATED CHEB. 
CALCULATED CHEB. 
CALCULATED CHEB. 
CALCULATED CHEB. 
CALCULATED CHEB. 
CALCULATED CHEB. 
CALCULATED CHEB. 
CALCULATED CHEB. 
CALCULATED CHEB. 
CALCULATED CHEB. 
CALCULATED CHEB. 



POLYNOM 

POLYNOM 

POLYNOM 

POLYNOM 

POLYNOM 

POLYNOM 

POLYNOM 

POLYNOM 

POLYNOM 

POLYNOM 

POLYNOM 

POLYNOM 

POLYNOM 

POLYNOM 

POLYNOM 

POLYNOM 



OF ORDER: 0 
OF ORDER: 1 
OF ORDER: 2 
OF ORDER: 3 
OF ORDER: 4 
OF ORDER: 5 
OF ORDER: 6 
OF ORDER:? 
OF ORDER: 3 
OF ORDER: 9 
OF ORDER: 10 
OF ORDER: 11 
OF ORDER: 12 
OF ORDER: 13 
OF ORDER: 14 
OF ORDER: 15 



Figure 3.24. Status Printout During Calculation of Chebyshev Polyno- 
mial. 

Some of the functions developed and included in the workspace axe finite 



specialized and were specifically coded as examples of solving the particular DSP 



homework assignments. Others axe provided as tools that can be applied to many 



different problems. As already mentioned, it is very easy to expand this set of tools 
to include others. 

In using the workspaces and functions, the instructor will usually provide 
only a subset of the fimctions developed here to students enrolled in the course. 
Students would then use the functions provided, as well as the general features of 
APL to solve the assigned problems. Since the workspaces axe extremely modular, 
an instructor will find it easy to select only those functions that he wants students 
to have and provide others at a later time. 
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IV. SUMMARY AND CONCLUSION 



The purpose of this thesis was to develop a convenient set of software tools for 
students and instructors in order to solve computer assignments in digital signal 
processing on personal computers using APL. 

The main requirement was achieved by developing APL workspaces with sets of 
functions that could be applied to perform DSP operations. Computer assignments 
in EC 3400. EC 3410, and EC 4440 are easily solved by using this software package. 
The user needs to have basic knowledge in APL and needs to know how to use part 
of the STATGRAPHICS package in the APL environment. However, this basic 
knowledge is easily acquired. 

The structure of the APL software is very flexible and convenient to use. By 
combining a few functions, the user can achieve complicated calculations with little 
programming effort. Any workspace can be expanded by the student or professor 
by adding new functions. 

The results of this thesis demonstrate that the APL is easy and convenient 
to use, especially in solving digital signal processing problems. This thesis will 
hopefully make it easier for new students to start using the language. 
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APPENDIX A 
USER MANUAL 

A. SYSTEM REQUIREMENTS 

The software package contains the following disks; 

1. APL*PLUS Executive Program version 5.1 or later by STSC 

2. STATGRAPHICS - Statistical Graphics System, version 2.1 or later by STSC 

3. Utility workspace, and EC3410, EC4440, and EC3400 workspaces 

STATGRAPHICS requires the following hardware and system software: 

1. IBM PC, PC-XT, PC-AT or compatible 

2. 512K RAM 

3. Keyboard with APL characters 

4. Two double-sided, double-density disk drives or one floppy disk and hard disk. 

5. Graphics adapter card 

6. DOS, version 2.0 or later 

7. Dot matrix graphics printer (optional) 

8. Math coprocessor (optional but recommended) 

The software package can be operated from floppy disks or from the hard disk. 

B. PREREQUISITES FOR USER 

In order to use the package efiiciently, the user should have a basic knowledge 
of APL. 

In addition, it is strongly recommended that a copy of the STATGRAPHICS 
manual [3] be available to the user since this Appendix refers the user to Ref. 3 
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for more explanations. The user should not have loaded any special DOS resident 
programs since this may interfere with the proper execution of STATGRAPHICS 
and cause the system to “hang up.” 

C. HOW TO GET INTO THE DSP LIBRARY 
Follow the instructions below to start the session: 

1. Start the computer using DOS. 

2. If you are using a dual floppy disk drive, place the APL*PLUS executive disk 
in the default disk drive. If you are using a hard disk system, make sure that 
the directory with the APL and STATGRAPHICS program (usually the APL 
directory) is your ctirrent directory. 

Enter: APLCOM if you are using APL version 5.1 or 

Enter: A if you are using APL version 6.4. 



These commands call up batch flies specifically for each version. A batch file 
contains a set of commands that must be executed before it runs the APL program 
in order to have the software matched with the specific hardware. 

The system will respond as follows: 



APUPLUS PC APPLICATION DEVELOPMENT SYSTEM 



I Version 5.1 Serial Number 134257 Copyright 1985, ST3C, Inc. I 

I All rights reserved. Unauthorized reproduction of this software I 

I is prohibited and violates U.S. Copyright Lays. APL*PLUS is a I 

I registered trademark and service mark of STSC, Inc. i 

‘ — " 

CLEAR ys 11/20/1987 14:31:54 

3. Place the desired DSP library disk in the default disk drive, as for example, 
the disk containing the UTILITY workspace. 

Enter: )LOAD UTILITY 

If you are using a hard disk and want to load the workspace from drive A, 
enter: )LOAD 0 UTILITY. The “0” (zero) stands for drive A, “1” stands for 
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drive B, and “2” stands for drive C (hard disk). The system will respond as 
follows: 



)LOAD 0 OTILITY 

0 OTILITY SAVED 12/13/1987 15:12:23 



NAVAL POSTGRADDATS SCHOOL MONTEREY . CALIFORNIA 



OTILITISS WORKSPACE 

THESIS BY 
Y.KATZIR.I.A.F. 

ADVISOR: PROF. C.W. THERRISN. 

VERSION' 1.0 SEPTEMBER 1937 



At this point you can use the UTILITY workspace as described in Appendices 
B, C, and D. 

4. Before terminating the session save your results by entering: 

)SAVE UTILITY or )SAVE 0 WSID (WSID means your file name) 
the system will respond: 



)SAVE 

0 UTILITY SAVED 11/19/1987 00: 24:06 

5. To terminate APL enter: )OFF and you will be automatically returned to 
DOS. 

D. USING STATGRAPHICS WITH APL 
Follow the instructions below to start the session: 

1. Start the computer under DOS. If a graphics printer is attached be sure that 
the printer is set up for graphics printing. (DOS has to run graphics.com when 
system boots.) 

2. Load APL as described in the previous section (C.b.) 

3. After the APL*PLUS PC system is loaded, replace the APL disk with the 
STATGRAPHICS staxt-up disk and enter: 

)LOAD STATGRAF 
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WARNING; When using the STATGRAF workspace use only the )PCOPY 
command to enter functions or variables into the workspace. 



During the loading procedure, the system will display a copyright banner and 
the following message: 

SYSTEM INITIALIZING. PLEASE BE PATIENT. THIS WILL TAKE A FEW MOMENTS.” 
When initialization is complete, the system will prompt for questions that are 
related to the computer configuration. Select the appropriate answers (See Ref. 

3, pg. 3-1 to 3-3 for more details.) The system will ask if you want to save the 
settings previously entered in order to have an automatic logon the next time you 
start STATGRAPHICS. The Main Menu will then be displayed as in Figure A.l. 



STATGRAPHICS Statistical Graphics System | 



DATA MANAGEMENT AND SYSTEM UTILITIES 
A. Data Management 
a. System Environment 
C. Report Writer and Graphics Replay 

0. Plotter Interface 

PLOTTING AND DESCRIPTIVE STATISTICS 
E« Plotting Functions 

F. Descriptive Methods 

G. Estimation and Tasting 

H. Distribution Functions 

1. Exploratory Data Analysis 

ANOVA AND REGRESSION ANALYSIS 

J. Analysis of Variance 

K. Regression Analysis 



TIME SERIES PROCEDURES 

L. Forecasting 

M. Quality Control 

N. Smoothing 

O. Time Series Analysis 

ADVANCED PROCEDURES 

P. Categorical Data Analysis 

Q. Multivariate Methods 

R. Nonparametric Methods 

S. Sampling 

T. Experimental Design 

MATHEMATICAL AND USER PROCEDURES 

U. Mathematical Functions 

V. Supplementary Operations 



Use cursor keys to highlight desired section. Then press ENTER. 

IHel p 2Edit 3Savscr 4Prtscr 5 6Go TVars 3Cad 9Raview LOQuit 

INPUT 11/13/87 13:08 STATGRAPHICS Vers. 2.1 



Figure A.l. Statgraphics Main Menu. 
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4. When you are in the Main Menu, press the ESC key to enter APL immediate 
execution mode. Execute the function. Enter: RESTART to return to the 
menu-control mode. 

Since the complete set of functions in the STATGRAPHICS system exceeds 
the memory space available on most personal computers, you should load only 
those functions and variables that are necessary to perform the desired tasks. For 
DSP applications the major procedures used axe described in the following section. 

D. STATGRAPHICS MAJOR PROCEDURES USED 

After starting STATGRAPHICS, the first display is the Main Menu (See Fig- 
ure A.l.) 

The Main Menu contains 22 sections under six major categories. 

The Main Menu gives you access to all the data analysis and graphics proce- 
dures. 

A highlighted cursor bar is displayed on the Main Menu screen. In order to 
select any desired Menu Procedure, move the cursor using the arrow keys and press: 
ENTER. STATGRAPHICS procedures are stored in four disks. When using floppy 
disks carefully follow the instruction on the screen. 

The following is a short description of the most frequently used procedures in 
this DSP software package: 

1. System Environments [3] 

The STATGRAPHICS system environment section is under category; 

‘'DATA MANAGEMENT AND SYSTEM UTILITIES'’ 

This section allows you to modify the STATGRAPHICS system environ- 
ment to fit your needs. This section has nine procedures. Those most often used 
are: 
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Normal Text 



Screen Options 



Graphics Mode 



Foreground Color CO-7): 7 
Background Color CO-7): 1 
Border Color CO- 15): 1 
Intense CO-1): 0 
Blinking CO-1): 0 



Active Text 



★ Resolution Cl=Low,2=High) : 2 

Background Color CO-15): o 

Palette Number CO-1): 1 

* not supported on all boards 

Highlighted Text 



Foreground Color CO-7): 0 
Background Color CO-7): 5 
Intense CO-1): 0 
Blinking CO-1): 0 



Foreground Color CO-7): 0 
Background Color CO-7): 2 
Intense CO-1): 0 
Blinking CO-1): 0 



Figure A.2. The Screen Options Menu. 



1. Screen option: Allows you to change colors, text, and properties of the graphics 
screen. (See Figure A.2). 



2. Graphic options: Allows you to change sizes, orientation, and positions of the 
graphics screen. (See Figure A. 3.) 



Graphics Options 



Lina colors: 123456739ABCDEF12345 
Point colors: 56789ABCDEF123451388 
Paint colors: 89ABCDEF123451234567 
Text color: 1 



Axis Color 


Ticmarks 


Text Size 




Color Viewpoint 


X 1 


In 


1 1 


Frame : Yes 


X 600 


X 1 


In 


1 1 


Grid: Both 


1 Y -1600 


2 1 


In 


1 1 


Border: None 


1 2 800 


Titlel 




1 1 






Titla2 




1 1 


Graphics Chirsor: 


Yes Graphics: Yes 








Pointsize: .005 


Ticmark length: .040 


Window 


Origin Width 


Split: 1 


Position: 1 


Horizontal 


.200 


.750 


Printing Zoom 


Factors 


Vertical 


.200 


.640 


Vertical : 1 


Horizontal: 1 








Page Orientation 


.: Vertical 



Figure A.3. Graphics Options Menu. 



2. Plotting Functions [3] 

Plotting functions axe found on the Main Menu under the category: 
‘‘PLOTTING AND DESCRIPTIVE STATISTICS'* 
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